Clean video switching among multiple video feeds in a security system

ABSTRACT

A system and method for using both video and periodically refreshed images in a video surveillance system is described herein the method comprising receiving a first request from a first device at a first camera for a first video stream generated by the first camera to be transmitted using a first communication path; beginning the process of establishing the first communications path from the first camera to the first device; establishing second communications path from the first camera to the first device while the first communications path is being established, wherein the second communications path can be used to transmit a plurality of periodically refreshed images while the first communications path is being established; transmitting the plurality of periodically refreshed images from the first camera to the first device using the second communications path while the first communications path is being established; and transmitting the first video stream from the first camera to the first device using the first communications path once it has been established, and then shutting down the transmission of the plurality of periodically refreshed images using the second communications path.

PRIORITY INFORMATION

The present application claims priority under 35 U.S.C. § 120 to U.S.Non-Provisional patent application Ser. No. 15/798,570, filed Oct. 31,2017 (Attorney Docket No. CP00424-00), the entire contents of which areexpressly incorporated herein by reference.

BACKGROUND OF THE INVENTION Technical Field

The embodiments described herein relate generally to video displaysystems, and more specifically to systems, methods, and modes fordisplaying still images in a general purpose control system in place ofvideo until such video is ready to be displayed.

Background Art

FIG. 1 illustrates a block diagram of a currently available multipleinput-multiple output (MIMO) video display system (MIMO-VDS) 100,configured in the form factor of a surveillance system that comprisesabout twelve different cameras 102 a-1, each of which provides a livevideo feed to central processing station (CPS) 108.

In MIMO-VDS 100, a plurality of video feeds, from cameras 102 a-1(typically digital cameras, but not necessarily), provide video to CPS108 via wireless (WL) transceiver links 104, or physical links(typically cables) 106. The received video signals are processed by VDSprocessor, memory, program/application (APP), and other internalcircuitry (VDS circuitry) 120, all of which are known to those of skillin the art, and displayed on video display 112, as shown in FIG. 1.Video display 112 can generally be divided into many different videodisplay areas, but in this case, twelve, as FIG. 1 illustrates. The 12separate display areas each correspond to respective video feed/cameras102 a-1. MIMO-VDS 100 further includes VDS interface 110 that allows oneor more users to control any and all aspects of MIMO-VDS 100. MIMO-VDS100 can also be operated remotely, via a local area network (LAN), widearea network (WAN), personal area network (PAN), or global area network(GAN), such as the internet.

The locally or remotely located operator(s) can watch each of the videosin first video display areas 114 a-1, and if desired, click on one tocreate a larger display area, such as second display area 116. In thiscase, the operator(s) can then have a larger viewing area of the camerafeed that was selected, so that the one or more users or operators cansee with greater detail the selected area. In the case of MIMO-VDS 100such re-display of the selected video feed occurs practicallyinstantaneously, as MIMO-VDS 100 is designed to receive and display thevarious video feeds as that is its primary purpose. Then, the remainingvideo displays are segregated into separate third video display areas118 a-1. Other configurations of the video display areas are possible aswell, and the above provided description is provided as a brief overviewonly.

Currently available MIMO-VDSs 100 can also be internet-protocol (IP)based. Currently available IP-based video surveillance equipment (e.g.cameras 102) provide high definition (HD)/high bandwidth video feeds toclient devices such as cellular telephones, or personal digitalassistants (PDAs) (devices) for monitoring and viewing. However, many ofthese portable, personal devices do not have the bandwidth or processingpower to easily lock onto and display these HD video streamsinstantaneously. Moreover, protocols used to setup such streamsintroduce latencies and delays in switching to these video feeds,especially when dealing with a multitude of varying vendors, such asthose that provide/manufacture cameras 102, and CPS 108, among otherdevices. These delays result in a less than optimum user experienceresulting from seconds of delayed video, black screens during videoswitching to different sources and an overall lagging behavior.

Accordingly, a need has arisen for systems, methods, and modes fordisplaying still images in place of video in a general purpose controlsystem until such video is ready to be displayed.

SUMMARY

It is an object of the embodiments to substantially solve at least theproblems and/or disadvantages discussed above, and to provide at leastone or more of the advantages described below.

It is therefore a general aspect of the embodiments to provide systems,methods, and modes for displaying still images in place of video in ageneral purpose control system until such video is ready to be displayedthat will obviate or minimize problems of the type previously described.

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used to limit the scope of the claimed subject matter.

Further features and advantages of the aspects of the embodiments, aswell as the structure and operation of the various embodiments, aredescribed in detail below with reference to the accompanying drawings.It is noted that the aspects of the embodiments are not limited to thespecific embodiments described herein. Such embodiments are presentedherein for illustrative purposes only. Additional embodiments will beapparent to persons skilled in the relevant art(s) based on theteachings contained herein.

According to a first aspect of the embodiments, a method for using bothvideo and periodically refreshed images in a video surveillance system,comprising: receiving a first request from a first device at a firstcamera for a first video stream generated by the first camera to betransmitted using a first communication path; beginning the process ofestablishing the first communications path from the first camera to thefirst device; establishing second communications path from the firstcamera to the first device while the first communications path is beingestablished, wherein the second communications path can be used totransmit a plurality of periodically refreshed images while the firstcommunications path is being established; transmitting the plurality ofperiodically refreshed images from the first camera to the first deviceusing the second communications path while the first communications pathis being established; and transmitting the first video stream from thefirst camera to the first device using the first communications pathonce it has been established, and then shutting down the transmission ofthe plurality of periodically refreshed images using the secondcommunications path.

According to the first aspect of the embodiments, the method furthercomprises a network switch adapted to receive the first request from thefirst device, and transmit the same to the first camera, establish boththe first and second communication paths between the first camera andthe first device through the network switch, shut down the secondcommunications path once the first communications path is established,and is further adapted to receive both of the transmitted plurality ofperiodically refreshed images and first video stream from the firstcamera and transmit both of the same to the first device.

According to the first aspect of the embodiments, the method furthercomprises transmitting a second request by the network switch to thefirst camera to generate and transmit a plurality of periodicallyrefreshed images using a second communications path.

According to the first aspect of the embodiments, both the first andsecond communications path are the same physical high bandwidth internetprotocol based communications path capable of transmitting videosignals.

According to the first aspect of the embodiments, the first and secondcommunications path are different physical internet protocol basedcommunications paths.

According to the first aspect of the embodiments, the video surveillancesystem is part of an enterprise management system.

According to the first aspect of the embodiments, the first device canbe any type of electronic device capable of wireless or wiredcommunications.

According to a second aspect of the embodiments, an enterprisemanagement system (system) is provided that includes a videosurveillance function feature, comprising, among other components: afirst camera adapted to generate both video and periodically refreshedimages, and to respond to requests for the same; a first device adaptedto receive and display both video and periodically refreshed images, andto generate a first request to the first camera for a first video streamgenerated by the first camera to be transmitted using a firstcommunication path; the enterprise management system adapted to generatecommands to establish the first communications path from the firstcamera to the first device, and to generate commands to establish asecond communications path from the first camera to the first devicewhile the first communications path is being established, and whereinthe second communications path can be used to transmit a plurality ofperiodically refreshed images while the first communications path isbeing established.

According to the second aspect of the embodiments, the system furthercomprises a network switch adapted to receive the first request from thefirst device and transmit the first request to the first camera for thefirst video stream, receive both video and periodically refreshed imagesfrom the first camera, and transmit both video and periodicallyrefreshed images to the first device, generate commands to establish thefirst and second communications paths, and generate commands toterminate the second communications path once the first communicationspath is established and transmitted the first video stream.

According to the second aspect of the embodiments, both the first andsecond communications path are the same physical high bandwidth internetprotocol based communications path capable of transmitting videosignals.

According to the second aspect of the embodiments, the first and secondcommunications path are different physical internet protocol basedcommunications paths.

According to the second aspect of the embodiments, the first device canbe any type of electronic device capable of wireless or wiredcommunications.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other objects and features of the embodiments will becomeapparent and more readily appreciated from the following description ofthe embodiments with reference to the following figures. Differentaspects of the embodiments are illustrated in reference figures of thedrawings. It is intended that the embodiments and figures disclosedherein are to be considered to be illustrative rather than limiting. Thecomponents in the drawings are not necessarily drawn to scale, emphasisinstead being placed upon clearly illustrating the principles of theaspects of the embodiments. In the drawings, like reference numeralsdesignate corresponding parts throughout the several views.

FIG. 1 illustrates a block diagram of a currently available multipleinput-multiple output (MIMO) video display system (MIMO-VDS), configuredin the form factor of a surveillance system that comprises twelvedifferent cameras, each of which provides a live video feed to a centralprocessing station.

FIG. 2 illustrates a block diagram of an internet-protocol (IP) basedsurveillance system (IP-BSS) that uses both video and periodicallyrefreshed images according to aspects of the embodiments.

FIG. 3 illustrates a flowchart of a method for using both video andstill images in an IP based surveillance system according to aspects ofthe embodiments.

FIG. 4 is a block diagram of the major components of both of a networkswitch and a client viewing device, which can be collectively referredto as an electronic processing/communications device suitable for use toimplement a method for using both video and periodically refreshedimages in an IP based surveillance system according to an aspect of theembodiments.

FIG. 5 illustrates a network within which the system and method forusing both video and periodically refreshed images in an IP basedsurveillance system can be used according to aspects of the embodiments.

DETAILED DESCRIPTION

The embodiments are described more fully hereinafter with reference tothe accompanying drawings, in which embodiments of the inventive conceptare shown. In the drawings, the size and relative sizes of layers andregions may be exaggerated for clarity. Like numbers refer to likeelements throughout. The embodiments may, however, be embodied in manydifferent forms and should not be construed as limited to theembodiments set forth herein. Rather, these embodiments are provided sothat this disclosure will be thorough and complete, and will fullyconvey the scope of the inventive concept to those skilled in the art.The scope of the embodiments is therefore defined by the appendedclaims. The detailed description that follows is written from the pointof view of a control systems company, so it is to be understood thatgenerally the concepts discussed herein are applicable to varioussubsystems and not limited to only a particular controlled device orclass of devices, such as control systems that can be used assurveillance systems.

Reference throughout the specification to “one embodiment” or “anembodiment” means that a particular feature, structure, orcharacteristic described in connection with an embodiment is included inat least one embodiment of the embodiments. Thus, the appearance of thephrases “in one embodiment” or “in an embodiment” in various placesthroughout the specification is not necessarily referring to the sameembodiment. Further, the particular feature, structures, orcharacteristics may be combined in any suitable manner in one or moreembodiments.

LIST OF REFERENCE NUMBERS FOR THE ELEMENTS IN THE DRAWINGS IN NUMERICALORDER

The following is a list of the major elements in the drawings innumerical order.

-   100 Conventional Multiple Input-Multiple Output Video Display System    (MIMO-VDS)-   102 Camera (High-definition/4K)-   104 Wireless (WL) Transceiver Link (including antenna)-   106 Physical Link (wired)-   108 Central Processing Station (CPS)-   110 VDS Interface-   112 Video Display-   114 First Video Display Area-   116 Second Video Display Area-   118 Third Video Display Area-   120 VDS Processor, Memory, and Program/Application and Other    Internal Circuitry (VDS Circuitry)-   200 Internet Protocol (IP) Based Surveillance System (IP-BSS)-   202 WiFi Transceiver-   203 Physical Internet Protocol (IP) Based Video Link (Physical IP    Link)-   204 Network (NW) Switch-   205 Wireless Internet Protocol Based Video Link (WL IP Link)-   206 Client Viewing Device (Device)-   208 Network Switch Video Surveillance System Application (NW Switch    App.)-   210 Physical/Wireless Device IP Based Link (Device Link)-   212 User Device Video Surveillance System Application (Device App.)-   300 Method for Using Both Video and Periodically Refreshed Images in    an IP Based Surveillance System-   302-314 Method Steps of Method 300-   400 Electronic Processing/Communications Device (EPD)-   402 Central Processor Unit (CPU)-   404 Nonvolatile Storage-   406 Main Memory-   408 Network Interfaces-   410 Wired Input/Output (I/O) Interface-   412 Personal Area Network (PAN) Interface-   414 Local Area Network (LAN) Interface-   416 Wide Area Network (WAN) Interface-   418 Programmable Relay Ports-   420 Internal Bus-   500 Network (NW) System-   506 Internet Service Provider (ISP)-   508 Modulator/Demodulator (MODEM)-   510 Wireless Router-   512 Plain Old Telephone Service (POTS) Provider-   514 Cellular Service Provider-   518 Communications Satellite-   520 Cellular Tower-   522 Internet-   524 Global Positioning System (GPS) Control Station-   526 Satellite Communication Systems Control Station-   528 Global Positioning System (GPS) Satellite

List of Acronyms Used in the Specification in Alphabetical Order

The following is a list of the acronyms used in the specification inalphabetical order.

-   3G Third Generation-   4G Fourth Generation-   App Application-   ASIC Application Specific Integrated Circuitry-   AV Audio Video-   BIOS Basic Input/Output System-   BT Bluetooth-   CD Compact Disk-   CPS Central Processing Station-   CPU Central Processing Unit-   DHCP Dynamic Host Communication Protocol-   DIN Deutsches Institut für Normung-   DNS Dynamic Name System-   DVD Digital Video/Versatile Disk-   EDGE Enhanced Data Rates for Global System for Mobile Communications    Evolution-   EGPRS Enhanced General Packet Radio Service-   EEPROM Electrically Erasable Programmable Read Only Memory-   EPD Electronic Processing/Communications Device-   FPGA Field Programmable Gate Array Structures-   GAN Global Area Network-   GPS Global Positioning System-   GSM Global System for Mobile Communications-   HD High Definition-   HDD Hard Disk Drive-   IMT-SC International Mobile Telecommunications-Single Carrier-   I/O Input-Output-   IP Internet-Protocol-   IP-BSS Internet-Protocol Based Surveillance System-   IR Infrared-   IrDA Infrared Data Association-   ISP Internet Service Provider-   LAN Local Area Network-   MIMO Multiple Input-Multiple Output-   MODEM Modulator-Demodulator-   NFC Near Field Communication-   NIC Network Interface Controller-   NW Network-   PAN Personal Area Network-   PC Personal Computer-   PDA Personal Digital Assistant-   POTS Plain Old Telephone Service-   RAM Random Access Memory-   RISC Reduced Instruction Set Processors-   ROM Read-only Memory-   USB Universal Serial Bus-   VDC Voltage, Direct Current-   VDS Video Display System-   WAN Wide Area Network-   WL Wireless

The different aspects of the embodiments described herein pertain to thecontext of systems, methods, and modes for displaying periodicallyrefreshed images in a general purpose control system in place of videountil such video is ready to be displayed, but is not limited thereto,except as may be set forth expressly in the appended claims.

For 40 years Creston Electronics Inc., has been the world's leadingmanufacturer of advanced control and automation systems, innovatingtechnology to simplify and enhance modern lifestyles and businesses.Crestron designs, manufactures, and offers for sale, integratedsolutions to control audio, video, computer, and environmental systems.In addition, the devices and systems offered by Crestron streamlinestechnology, improving the quality of life in commercial buildings,universities, hotels, hospitals, and homes, among other locations.Accordingly, the systems, methods, and modes of the aspects of theembodiments described herein, as embodied as IP Based SurveillanceSystem (IP-BSS) 200 can be manufactured by Crestron Electronics Inc.,located in Rockleigh, N.J.

Attention is now directed towards FIG. 2, which illustrates a blockdiagram of IP-BSS 200 that uses both video and periodically refreshedimages according to aspects of the embodiments, and to FIG. 3, whichillustrates a flowchart of method 300 for using both video andperiodically refreshed images in an IP based surveillance systemaccording to further aspects of the embodiments.

IP-BSS 200 comprises one or more cameras 102, WiFi transceiver (WiFi)202, physical IP links 203, network (NW) switch 204, WL internetprotocol based video link (WL IP link) 205, at least one client videoviewing device (device) 206, NW switch video surveillance systemapplication (NW switch App) 208, physical/wireless device IP based link(device link) 210, and user device video surveillance system application(device App) 212, according to aspects of the embodiments. Infulfillment of the dual purposes of clarity and brevity, a detaileddiscussion of known components, such as WiFi transceiver 202, whichoperates in a conventional manner, and the like, shall be omitted fromdiscussion herein. In addition, as with VDS circuitry 120, describedabove, NW switch 204 comprises standard internal circuitry and operatesin a conventional manner but for the manner in which it handles videoand periodically refreshed images according to aspects of theembodiments, as will be described in detail herein.

In MIMO-VDS 100, there is practically no lag time between when anoperator selects a video feed to when it is displayed on video display112, whether in first video display area 114, or second video displayarea 116. This is due, at least in part, to the dedicated nature ofMIMO-VDS 100 and the fact that the system is focused on processing highspeed digital video feeds, and little else. However, IP-BSS 200according to aspects of the embodiments, has neither the same dedicatedprocessing power, nor a sole function; that is, in addition tomonitoring video feeds, IP-BSS 200 also performs a host of additionalcontrol and command functions, and includes many useful features.Nonetheless, many users still desire the surveillance functionality thatcan be incorporated in a “whole-enterprise” management system such asIB-PSS 200 can be part of. Thus, a means to afford additional improvedfunctionality is needed.

Therefore, aspects of the embodiments as embodied within IB-PSS 200 aimto improve the user surveillance experience by taking advantage of bothvideo and periodically refreshed images that can be provided by cameras102 in a substantially simultaneous manner According to aspects of theembodiments, NW switch App 208, which can be stored in one or more ofseveral types of memory within NW switch 204 (the physical aspects ofwhich are described in greater detail below), accepts dual streamlocations for the one or more video surveillance devices (e.g., cameras102).

According to aspects of the embodiments, when an initial stream isrequested by the user (by pressing a button on interactive device App212 stored in memory of device 206), or a switch from a first videostream to a second video stream is requested (by a similar action;method step 302), device 206 generates a command that is transmitted toNW switch 204 (method step 304), via device link 210 (which can be wiredor wireless, and performed locally or remotely, through one or more of acellular NW, LAN, WAN, GAN, among other network types). NW switch App208 in NW switch 204 receives the command, and performs at least twooperations: the first is to stop the transmission of the former videosignal from NW switch 204 to device 206 (method step 306), and thesecond is to generate and transmit one or more signals to the selectedcamera 102 x (method step 308).

Selected camera 102 x then substantially instantaneously generates alower resolution stream of periodically refreshed images (method step310); according to aspects of the embodiments, the periodicallyrefreshed images can be generated either by a still camera function orextracted from a video stream generated by selected camera 102 x; asthose of skill in the art can appreciate, in general cameras 102 aresubstantially continuously generating video images even though they havenot been selected. Their outputs are just not used, but can be accessedsubstantially immediately.

Prior to addressing the remainder of the process for actual transmissionof the periodically refreshed images and then the new video stream, itis useful to address the manner in which video and image data isgenerally transmitted using systems such as IP-BSS 200. As those ofskill in the art can appreciate, when setting up IP-BSS 200 it istypically not the case that there will be two physical links between anyone camera 102 and NW switch 204, though that can be the case. Thetypical scenario is one in which there is only one physical path betweencamera 102 and NW switch 204, and that path is either a wired path 203or a wireless path 205. Therefore, both the periodically refreshedimages and new video stream can use the same path (namely a wiredEthernet or wireless connection 203, 205 to NW switch 204). According toaspects of the embodiments, an advantage of using both periodicallyrefreshed images and a new video stream is to reduce the amount of timea user does not see anything, or views frozen video images.

As those of skill in the art can appreciate, setting up a video streamusing an IP based communication path generally requires more handshaking(setting up a session or locking onto an I-Frame) to synchronize thestream between the receiver and the sender, than when sending stillimages. The video setup handshaking can take anywhere from a few hundredmilliseconds to a second or longer, depending on different variablessuch as processing speed in both the transmitter and receiver,transmitter i-frame intervals, available bandwidth and even therespective processor load(s). According to aspects of the embodiments,using a still image substantially circumvents the video handshaking timedelay up front and allows for a substantially immediate retrieval of thestill image to display on device 206.

As those of skill in the art can further appreciate, still images aregenerally of lower resolution and require less transfer of data to getto a receiver, in this case, NW switch 204. Therefore, still images, andin particular periodically refreshed images, can get transferredsubstantially faster than a video stream. As those of skill in the artcan appreciate, a video stream is typically transmitted at about 24-30frames per second, where as a periodically refreshed image can betransmitted at about 2-3 frames per second, which, according to aspectsof the embodiments, still provides the appearance of a “live videostream,” albeit not as smoothly as an actual video stream.

As those of skill in the art can still further appreciate, typical videostreams from cameras 102 can be transmitted via an IP based wired orwireless path with a bandwidth ranging from about several hundredkilo-bits-per second (Kbps) (about 700 Kbps) to a few mega-bits-persecond (Mbps) (abut 2-10 Mbps). According to aspects of the embodiments,IP BSS 200 implements a video stream in an IP based path using abandwidth of 2.5 MBPS.

That is, when the command that has been generated by NW switch App 208in NW switch 204 is received at selected camera 102 x, selected camera102 x substantially immediately generates and transmits a plurality ofperiodically refreshed images produced either as a series of still imagecaptures, or a series of single frame extractions from the video streamprior to processing and transmission (such processing can include, amongother functions, one or more of each of data compression and encryptionalgorithms).

According to further aspects of the embodiments, a plurality ofperiodically refreshed images can be generated and transmittedsubstantially periodically to give the user of device 206 the appearanceof a near real-time view of selected camera 102 x using a first IP basedcommunication path; this gives NW switch 204 time to set up a second IPbased communication path between selected camera 102 x, itself, anddevice 206. Displaying the plurality of periodically refreshed imagesprovides the appearance of a video image. As those of skill in the artcan appreciate, either or both of physical IP link 203 and WL IP link205 can be of sufficient bandwidth to support a plurality of highbandwidth communication paths. As those of skill in the art can furtherappreciate, physical IP link 203 can be a fiber optic cable, or category5 Ethernet cable, or some other similar type/bandwidth cable. WL IP link205 can also support multiple IP based video-capable bandwidthcommunication paths. According to still further aspects of theembodiments, either or both of the first and second IP basedcommunications paths can utilize BlueTooth communications technology, aWiFi communications path, a cellular telephone communications path, or anear field communications (NFC) path

While the lower bandwidth, and low set-up time periodically refreshedimages are being transmitted from selected camera 102 x over the lowbandwidth IP based communication path, received by NW switch 204 (methodstep 312), and then transmitted to device 206 (method step 312), NWswitch 204 is creating a relatively higher bandwidth, higher definitionvideo stream (new video stream), which is simultaneously connected andset up in the background (method step 312).

NW switch 204 monitors the development of the new video stream, and onceit is available and ready to display, it is seamlessly transitioned ontothe screen of device 206 (method step 314). The result is the user neversees any substantial interruption in video provided by the previouscamera 102 and newly selected camera 102 x, such that switching betweensources appears substantially instantaneous and smooth.

According to aspects of the embodiments, such substantially seamlesstransitioning between video images generated by two different cameras102 x-1 and 102 x would otherwise be impossible to achieve without usinghard-wired cameras and/or much more expensive, sophisticated hardware incamera 102, as well in the other hardware devices.

FIG. 4 is a block diagram of the major components of both of NW switch204 and device 206, which can be collectively referred to as electronicprocessing/communications device (EPD) 400 suitable for use to implementmethod 300 for using both video and periodically refreshed images in anIP based surveillance system according to an aspect of the embodiments.As those of skill in the art can appreciate, both of NW switch 204 anddevice 206 will not only have a core set of common components withrespective functionality, but also individual components andfunctionalities particular to their respective uses in IP-BSS 200.According to aspects of the embodiments, the functionality of method 300in NW switch App 208 and device App 212 can be implanted in EPD 400,which can also embody the functionality of device 206 and NW switch 204;however, in fulfillment of the dual purposes of clarity and brevity, thediscussion of FIG. 4 pertains to those core set of common components andrespective functionalities, and thus has been represented, for purposesof this discussion, as EPD 400 according to aspects of the embodiments.

EPD 400 can include at least one central processing unit (CPU) 402, aswell as internal bus 420, the operation of which is known to those ofskill in the art. Aspects of the embodiments of CPU 402 are described ingreater detail below. For example, CPU 402 can represent one or moremicroprocessors, and the microprocessors may be “general purpose”microprocessors, a combination of general and special purposemicroprocessors, or application specific integrated circuits (ASICs).Additionally, or alternatively, CPU 402 can include one or more reducedinstruction set processors (RISC), video processors, or related chipsets. CPU 402 can provide processing capability to execute and runvarious applications, and/or provide processing for one or more of thetechniques described herein. Applications that can run on EPD 400 caninclude, for example, software for processing control commands, softwarefor managing a calendar, software for controlling other electronicdevices via a control network as noted above, among other types ofsoftware/applications.

EPD 400 can further include main memory 406, which can be communicablycoupled to CPU 402, and which can store data and executable code, asknown to those of skill in the art. Main memory 406 can representvolatile memory such as random access memory (RAM), but can also includenonvolatile memory, such as read-only memory (ROM) or Flash memory. Inbuffering or caching data related to operations of CPU 402, main memory406 can store data associated with applications running on EPD 400.

EPD 400 can also further include nonvolatile storage 404. Nonvolatilestorage 404 can represent any suitable, nonvolatile storage medium, suchas a hard disk drive (HDD) or nonvolatile memory, such as flash memory.Being well-suited to long-term storage, nonvolatile storage 404 canstore data files such as media, software, and preference information.Nonvolatile storage 404 can be removable and interchangeable, therebyallowing portability of stored files, such as project files, among othertypes, as created during programming of IP-BSS 200. According to aspectsof the embodiments, project files can be used to map user desires intofunctions; as used thusly, project files are configuration files. Theseproject files describe all the devices IP-BSS 200 has knowledge of, whattypes of devices they are, how they operate, and the operatingparameters, among other features of each controllable device associatedwith IP-BSS 200.

Also shown as part of EPD 400 is network interface 408. Networkinterface 408 provides interface capability with one or more of severaldifferent types of network interfaces, including PAN interface 412, LANinterface 414, and WAN interface 416. Each of the network interfaces412, 414, and 416 can provide connectivity for EPD 400. Networkinterface 408 can represent, for example, one or more network interfacecontrollers (NICs) or a network controller. As those of skill in the artcan appreciate, the difference between a LAN and PAN can be lesscertain, and more one of degree; that is, in some cases, PANs aredefined as those interconnections of devices that are within a fewmeters of each other, while other definitions indicated that devicesthat are within ten meters or so and are interconnected can beconsidered to be within a PAN. Regardless of the exact definition, or,if no exact definition should ever exist, IP-BSS 200 can make use ofeach of a WAN, LAN, and PAN, or sometimes two or all three at one time,depending on the circumstances, as those of skill in the art can nowappreciate.

According to certain aspects of the embodiments, network interface 408can include PAN interface 412. PAN interface 412 can providecapabilities to network with, for example, a Bluetooth® network, or anear field communication (NFC) type network. As can be appreciated bythose of skill in the art, the networks accessed by PAN interface 412can, but do not necessarily, represent low power, low bandwidth, orclose range wireless connections. PAN interface 412 can permit oneelectronic device to connect to another local electronic device via anad-hoc or peer-to-peer connection. However, the connection can bedisrupted if the separation between the two electronic devices exceedsthe proscribed range capability of PAN interface 412.

Network interface 408 can also include LAN interface 414. LAN interface414 can represent an interface to a wired Ethernet-based network, butcan also represent an interface to a wireless LAN, such as an 802.11xwireless network. The range of LAN interface 414 can generally exceedthe range available via PAN interface 412. Additionally, in many cases,a connection between two electronic devices via LAN interface 414 caninvolve communication through a network router or other intermediarydevice, such as WiFi transceiver 202 (shown in FIG. 2). LAN interfacescan also incorporate IEEE 802.15.4 (e.g. Zigbee) network, or anultra-wideband network. As those of skill in the art can appreciate, thenetworks described by IEEE 802.15.4 are mesh-type networks, and operatewith a central router/coordinator; in IP-BSS 200, the function of suchcentral coordination is performed by EPD 400, according to aspects ofthe embodiments.

As known by those of skill in the art, Ethernet connectivity enablesintegration with IP-controllable devices and allows EPD 400 to be partof a larger managed control network. Whether residing on a sensitivecorporate LAN, a home network, or accessing the Internet through a cablemodem, EPD 400 can provide secure, reliable interconnectivity withIP-enabled devices, such as touch screens, computers, mobile devices,video displays, Blu-ray Disc® players, media servers, security systems,lighting, HVAC, and other equipment—both locally and globally.

EPD 400 can also include one or more wired I/O interface 410 for a wiredconnection between EPD 400 and one or more electronic devices. Wired I/Ointerface 410 can represent a serial port. A serial port, as those ofskill in the art can appreciate, is a serial communication physicalinterface through which information transfers in or out one bit at atime (as opposed to a parallel port). While it is known that interfacessuch as Ethernet, FireWire, and universal serial bus (USB), all senddata as a serial stream, the term “serial port” usually identifieshardware more or less compliant to the RS-232 standard, intended tointerface with a modem or with a similar communication device.

Wired I/O interface 410 can also represent, for example, a Cresnet port.Cresnet provides a network wiring solution for Crestron keypads,lighting controls, thermostats, and other devices that do not requirethe higher speed of Ethernet. The Cresnet bus offers wiring andconfiguration, carrying bidirectional communication and 24 volts, directcurrent (VDC) power to each device over a simple 4-conductor cable.

One or more infrared (IR) interfaces can also be part of wired I/Ointerface 410; the IR interface can enable EPD 400 to receive and/ortransmit signals with infrared light. The IR interface can comply withthe Infrared Data Association (IrDA) specification for datatransmission. Alternatively, the IR interface can function exclusivelyto receive control signals or to output control signals. The IRinterface can provide a direct connection with one or more devices suchas a centralized audio/video (AV) sources, video displays, and otherdevices.

EPD 400 can also include, but not necessarily, one or more programmablerelay ports 418 a-c. Programmable relay ports 418 can be used by EPD 400to control window shades, projection screens, lifts, power controllers,and other contact-closure actuated equipment. EPD 400 can include, asprogrammable relay port 418, a “Versiport” relay port that ismanufactured by Crestron Electronics Inc., of Rockleigh, N.J. TheVersiport relay port can be managed by a DIN type module (DeutschesInstitut für Normung), more specifically a DIN-IO8 module (alsomanufactured by Crestron Electronics Inc.), which is a DIN rail-mountedautomation control module that provides eight Versiport I/O ports forinterfacing with a wide range of third-party devices and systems. Each“Versiport” can be configured via software to function as a digital oranalog sensing input, or as a digital trigger output. When configured asa digital input, the Versiport can sense a contact closure or logiclevel signal from devices such as motion detectors, partition sensors,alarm panels, 12 VDC triggers, and all types of switches and relays.When configured as an analog input, the Versiport can sense changes in aresistance or DC voltage level, working with everything from temperatureand light sensors to water level meters to volume controlpotentiometers. When operating as a digital output, the Versiportprovides a logic level closure signal to trigger control and alarminputs on a variety of external devices.

Thus, one or more “Versiport” programmable relay ports 418 can enablethe integration of occupancy sensors, power sensors, door switches, orother devices by providing a dry contact closure, low-voltage logic, or0-10 VDC signal.

According to further aspects of the embodiments in regard to EPD 400,network interfaces 408 can include the capability to connect directly toa WAN via a WAN interface 416. WAN interface 416 can permit connectionto a cellular data network, such as the enhanced data rates for globalsystem for mobile communications (GSM) Evolution (EDGE) (also known asenhanced general packet radio service (EGPRS), or international mobiletelecommunications (IMT) single carrier (IMT-SC) EDGE network, or otherthird generation/fourth generation (3G/4G) cellular telecommunicationnetworks (a detailed discussion of which is both not needed tounderstand the aspects of the embodiments, and beyond the scope of thisdiscussion). When connected via WAN interface 216, EPD 400 can remainconnected to the internet and, in some embodiments, to one or more otherelectronic devices, despite changes in location that might otherwisedisrupt connectivity via PAN interface 412 or LAN interface 414.

By leveraging remote access of EPD 400, a user can control one or moreof the controllable devices and/or environment settings in a facility(home, place of business or manufacture, or enterprise location) fromsubstantially anywhere in the world using device 206. Such control canbe accomplished by a dynamic domain name system (DNS) service. Those ofskill in the art can appreciate that DNS is a hierarchical distributednaming system used for computers, services, or any resource that isconnected to the internet or a private network. According to furtheraspects of the embodiments, EPD 400 can be configured to utilize dynamichost communication protocol (DHCP) communications that include ahostname prefixed by a model number.

As also will be appreciated by one skilled in the art, the variousfunctional aspects of the embodiments can be embodied in a wirelesscommunication device, a telecommunication network, or as a method or ina computer program product. Accordingly, the embodiments can take theform of an entirely hardware embodiment or an embodiment combininghardware and software aspects. Further, the embodiments can take theform of a computer program product stored on a computer-readable storagemedium having computer-readable instructions embodied in the medium. Anysuitable computer-readable medium can be utilized, including hard disks,compact disk (CD) ROMs, digital versatile discs (DVDs), optical storagedevices, or magnetic storage devices such a floppy disk or magnetictape. Other non-limiting examples of computer-readable media includeflash-type memories or other known types of memories.

Further, those of ordinary skill in the art in the field of theembodiments can appreciate that such functionality can be designed intovarious types of circuitry, including, but not limited to fieldprogrammable gate array structures (FPGAs), ASICs, microprocessor basedsystems, among other types. A detailed discussion of the various typesof physical circuit implementations does not substantively aid in anunderstanding of the embodiments, and as such has been omitted for thedual purposes of brevity and clarity. However, as well known to those ofordinary skill in the art, the systems and methods discussed herein canbe implemented as discussed, and can further include programmabledevices.

Such programmable devices and/or other types of circuitry as previouslydiscussed can include a processing unit, a system memory, and a systembus that couples various system components including the system memoryto the processing unit. The system bus can be any of several types ofbus structures including a memory bus or memory controller, a peripheralbus, and a local bus using any of a variety of bus architectures.Furthermore, various types of computer readable media can be used tostore programmable instructions. Computer readable media can be anyavailable media that can be accessed by the processing unit. By way ofexample, and not limitation, computer readable media can comprisecomputer storage media and communication media. Computer storage mediaincludes volatile and nonvolatile as well as removable and non-removablemedia implemented in any method or technology for storage of informationsuch as computer readable instructions, data structures, program modulesor other data. Computer storage media includes, but is not limited to,RAM, ROM, electrically erasable programmable read only memory (EEPROM),flash memory or other memory technology, CD-ROM, DVD or other opticaldisk storage, magnetic cassettes, magnetic tape, magnetic disk storageor other magnetic storage devices, or any other medium which can be usedto store the desired information and which can be accessed by theprocessing unit. Communication media can embody computer readableinstructions, data structures, program modules or other data in amodulated data signal such as a carrier wave or other transportmechanism and can include any suitable information delivery media.

The system memory can include computer storage media in the form ofvolatile and/or nonvolatile memory such as ROM and/or RAM. A basicinput/output system (BIOS), containing the basic routines that help totransfer information between elements connected to and between theprocessor, such as during start-up, can be stored in memory. The memorycan also contain data and/or program modules that are immediatelyaccessible to and/or presently being operated on by the processing unit.By way of non-limiting example, the memory can also include an operatingsystem, application programs, other program modules, and program data.

The processor can also include other removable/non-removable andvolatile/nonvolatile computer storage media. For example, the processorcan access a hard disk drive that reads from or writes to non-removable,nonvolatile magnetic media, a magnetic disk drive that reads from orwrites to a removable, nonvolatile magnetic disk, and/or an optical diskdrive that reads from or writes to a removable, nonvolatile opticaldisk, such as a CD-ROM or other optical media. Otherremovable/non-removable, volatile/nonvolatile computer storage mediathat can be used in the operating environment include, but are notlimited to, magnetic tape cassettes, flash memory cards, digitalversatile disks, digital video tape, solid state RAM, solid state ROMand the like. A hard disk drive can be connected to the system busthrough a non-removable memory interface such as an interface, and amagnetic disk drive or optical disk drive can be connected to the systembus by a removable memory interface, such as an interface.

The embodiments discussed herein can also be embodied ascomputer-readable codes on a computer-readable medium. Thecomputer-readable medium can include a computer-readable recordingmedium and a computer-readable transmission medium. Thecomputer-readable recording medium is any data storage device that canstore data which can be thereafter read by a computer system. Examplesof the computer-readable recording medium include ROM, RAM, CD-ROMs andgenerally optical data storage devices, magnetic tapes, flash drives,and floppy disks. The computer-readable recording medium can also bedistributed over network coupled computer systems so that thecomputer-readable code is stored and executed in a distributed fashion.The computer-readable transmission medium can transmit carrier waves orsignals (e.g., wired, or wireless data transmission through theInternet). Also, functional programs, codes, and code segments to, whenimplemented in suitable electronic hardware, accomplish or supportexercising certain elements of the appended claims can be readilyconstrued by programmers skilled in the art to which the embodimentspertains.

The disclosed embodiments provide a system and method for using bothvideo and periodically refreshed images in an IP based surveillancesystem. It should be understood that this description is not intended tolimit the embodiments. On the contrary, the embodiments are intended tocover alternatives, modifications, and equivalents, which are includedin the spirit and scope of the embodiments as defined by the appendedclaims. Further, in the detailed description of the embodiments,numerous specific details are set forth to provide a comprehensiveunderstanding of the claimed embodiments. However, one skilled in theart would understand that various embodiments can be practiced withoutsuch specific details.

FIG. 5 illustrates network (NW) system 500 within which IP-BSS 200 andmethod 300 for using both video and periodically refreshed images in anIP based surveillance system can be used/operated according to an aspectof the embodiments. Much of the network system infrastructure shown inFIG. 5 is or should be known to those of skill in the art, so, infulfillment of the dual purposes of clarity and brevity, a detaileddiscussion thereof shall be omitted.

According to aspects of the embodiments, a user of IP-BSS 200 and method300 for using both video and periodically refreshed images in an IPbased surveillance system would have device App 212 on their device 206and NW switch App 208 located in EPD 400 (or NW switch 204); device 206can include, but are not limited to, so-called smart phones, tablets,personal digital assistants, notebook and laptop computers, as well as aplurality of any other stationary or mobile electronic devices that canaccess the internet and/or cellular phone service or can facilitatetransfer of the same type of data in either a wired or wireless manner.For purposes of this discussion, the user shall be discussed as usingonly device 206 as if it were cellular based device, i.e., a smartphone,though such discussion should be understand to be in a non-limitingmanner in view of the discussion above about the other types of devicesthat can access, use, and provide such information.

In FIG. 5, the user has device 206, which can access cellular serviceprovider 514, either through a wireless connection (cellular tower 520)or via a wireless/wired interconnection (a “Wi-Fi” system thatcomprises, e.g., modulator/demodulator (modem) 508, WiFi transceiver202, EPD 400, internet service provider (ISP) 506, and internet 522).Further, device 206 can include NFC, “Wi-Fi,” and Bluetooth (BT)communications capabilities as well, all of which are known to those ofskill in the art. To that end, NW system 500 further includes, as manyhomes (and businesses) do, one or more EPDs 400 that can be connected toWiFi transceiver 202 via a wired connection (e.g., through modem 508) orvia a wireless connection (e.g., BT). Modem 508 can be connected to ISP506 to provide internet based communications in the appropriate formatto end users (e.g., EPD 400), and which takes signals from the end usersand forwards them to ISP 506. Such communication pathways are well knownand understand by those of skill in the art, and a further detaileddiscussion thereof is therefore unnecessary.

Device 206 can also access global positioning system (GPS) satellite528, which is controlled by GPS station 524, to obtain positioninginformation (which can be useful for different aspects of theembodiments), or device 206 can obtain positioning information viacellular service provider 514 using cell tower(s) 520 according to oneor more well-known methods of position determination. Some devices 206can also access communication satellites 518 and their respectivesatellite communication systems control station 526 (the satellite inFIG. 5 is shown common to both communications and GPS functions) fornear-universal communications capabilities, albeit at a much higher costthan conventional “terrestrial” cellular services. Device 206 can alsoobtain positioning information when near or internal to a building (orarena/stadium) through the use of one or more of NFC/BT devices, thedetails of which are known to those of skill in the art. FIG. 5 alsoillustrates other components of NW system 500 such as POTS provider 512.

According to further aspects of the embodiments, NW system 500 alsocontains EPD 400, wherein one or more processors, using known andunderstood technology, such as memory, data and instruction buses, andother electronic devices, can store and implement code that canimplement the system and method for using both video and periodicallyrefreshed images in an IP based surveillance system according to anembodiment.

As described above, an encoding process is discussed in reference toFIG. 3 and method 300. The encoding process is not meant to limit theaspects of the embodiments, or to suggest that the aspects of theembodiments should be implemented following the encoding process. Thepurpose of the encoding process is to facilitate the understanding ofone or more aspects of the embodiments and to provide the reader withone or many possible implementations of the processed discussed herein.FIG. 3 illustrates a flowchart of various steps performed during theencoding process. The steps of FIG. 3 are not intended to completelydescribe the encoding process but only to illustrate some of the aspectsdiscussed above.

The disclosed embodiments provide a system, software, and a method forusing both video and periodically refreshed images in an IP basedsurveillance system. It should be understood that this description isnot intended to limit the embodiments. On the contrary, the embodimentsare intended to cover alternatives, modifications, and equivalents,which are included in the spirit and scope of the embodiments as definedby the appended claims. Further, in the detailed description of theembodiments, numerous specific details are set forth to provide acomprehensive understanding of the claimed embodiments. However, oneskilled in the art would understand that various embodiments can bepracticed without such specific details.

Although the features and elements of aspects of the embodiments aredescribed being in particular combinations, each feature or element canbe used alone, without the other features and elements of theembodiments, or in various combinations with or without other featuresand elements disclosed herein.

This written description uses examples of the subject matter disclosedto enable any person skilled in the art to practice the same, includingmaking and using any devices or systems and performing any incorporatedmethods. The patentable scope of the subject matter is defined by theclaims, and can include other examples that occur to those skilled inthe art. Such other examples are intended to be within the scope of theclaims.

The above-described embodiments are intended to be illustrative in allrespects, rather than restrictive, of the embodiments. Thus, theembodiments are capable of many variations in detailed implementationthat can be derived from the description contained herein by a personskilled in the art. No element, act, or instruction used in thedescription of the present application should be construed as criticalor essential to the embodiments unless explicitly described as such.Also, as used herein, the article “a” is intended to include one or moreitems.

All United States patents and applications, foreign patents, andpublications discussed above are hereby incorporated herein by referencein their entireties.

INDUSTRIAL APPLICABILITY

To solve the aforementioned problems, the aspects of the embodiments aredirected towards systems, methods, and modes for displaying periodicallyrefreshed images in a general purpose control system in place of videountil such video is ready to be displayed.

ALTERNATE EMBODIMENTS

Alternate embodiments can be devised without departing from the spiritor the scope of the different aspects of the embodiments.

What is claimed is:
 1. A method for using both video and periodicallyrefreshed images in a video surveillance system, comprising: receiving afirst request from a first device at a first camera for a first videostream generated by the first camera to be transmitted using a firstcommunication path; beginning the process of establishing the firstcommunications path from the first camera to the first device;establishing second communications path from the first camera to thefirst device while the first communications path is being established,wherein the second communications path can be used to transmit aplurality of periodically refreshed images while the firstcommunications path is being established; transmitting the plurality ofperiodically refreshed images from the first camera to the first deviceusing the second communications path while the first communications pathis being established; and transmitting the first video stream from thefirst camera to the first device using the first communications pathonce it has been established, and then shutting down the transmission ofthe plurality of periodically refreshed images using the secondcommunications path.
 2. The method according to claim 1, furthercomprising: a network switch adapted to receive the first request fromthe first device, and transmit the same to the first camera, establishboth the first and second communication paths between the first cameraand the first device through the network switch, shut down the secondcommunications path once the first communications path is established,and is further adapted to receive both of the transmitted plurality ofperiodically refreshed images and first video stream from the firstcamera and transmit both of the same to the first device.
 3. The methodaccording to claim 2, further comprising: transmitting a second requestby the network switch to the first camera to generate and transmit aplurality of periodically refreshed images using a second communicationspath.
 4. The method according to claim 1, wherein both the first andsecond communications path are the same physical high bandwidth internetprotocol based communications path capable of transmitting videosignals.
 5. The method according to claim 1, wherein the first andsecond communications path are different physical internet protocolbased communications paths.
 6. The method according to claim 1, whereinthe video surveillance system is part of an enterprise managementsystem.
 7. The method according to claim 1, wherein the first device canbe any type of electronic device capable of wireless or wiredcommunications.
 8. An enterprise management system (system) including avideo surveillance function feature, comprising, among other components:a first camera adapted to generate both video and periodically refreshedimages, and to respond to requests for the same; a first device adaptedto receive and display both video and periodically refreshed images, andto generate a first request to the first camera for a first video streamgenerated by the first camera to be transmitted using a firstcommunication path; the enterprise management system adapted to generatecommands to establish the first communications path from the firstcamera to the first device, and to generate commands to establish asecond communications path from the first camera to the first devicewhile the first communications path is being established, and whereinthe second communications path can be used to transmit a plurality ofperiodically refreshed images while the first communications path isbeing established.
 9. The system according to claim 8, furthercomprising: a network switch adapted to receive the first request fromthe first device and transmit the first request to the first camera forthe first video stream, receive both video and periodically refreshedimages from the first camera, and transmit both video and periodicallyrefreshed images to the first device, generate commands to establish thefirst and second communications paths, and generate commands toterminate the second communications path once the first communicationspath is established and transmitted the first video stream.
 10. Thesystem according to claim 8, wherein both the first and secondcommunications path are the same physical high bandwidth internetprotocol based communications path capable of transmitting videosignals.
 11. The method according to claim 8, wherein the first andsecond communications path are different physical internet protocolbased communications paths.
 12. The system according to claim 8, whereinthe first device can be any type of electronic device capable ofwireless or wired communications.